docs: add QVAC to model providers - #12579
Conversation
|
All contributors have signed the CLA ✍️ ✅ |
|
I have read the CLA Document and I hereby sign the CLA |
|
Friendly ping @sestinj. This PR is docs-only and the branch is mergeable. The blockers I can see are I attempted to rerun the failed workflow from my side; if that does not clear the blockers, could you advise whether these can be rerun/overridden for this docs-only change or whether you want me to refresh the branch? |
|
@sestinj, could you help unblock this docs-only PR? The branch is mergeable, while the remaining failures are the unrelated JetBrains test and Continuous AI agent errors. Could those checks be rerun or overridden for review? |
|
@sestinj quick follow-up on this docs-only PR. The branch is mergeable, and the visible blockers are plus status failures that look unrelated to the docs change. Could you advise whether these can be rerun/overridden so review can proceed? |
|
@sestinj correction to my previous note: the visible blockers are jetbrains-tests and multiple Continuous AI checks, which look unrelated to this docs-only change. Could you advise whether those can be rerun or overridden so review can proceed? |
Add a provider page for QVAC, a local-first, OpenAI-compatible runtime. It documents installing the CLI, starting the server with `qvac serve openai`, and configuring Continue via the `openai` provider pointed at the local apiBase. Includes recommendations for context size, reasoning-tuned models, and model choice for tool-calling quality. Registers the page in the More Providers navigation and the Local Model Options table in the overview.
2adf2ea to
0aa9b30
Compare
Description
Adds a provider page for QVAC, an open-source, local-first runtime that exposes an OpenAI-compatible HTTP server via
qvac serve openai. Because the server speaks the OpenAI API, Continue connects to it through the built-inopenaiprovider with a localapiBase— no new provider type is needed.The page mirrors the existing local / OpenAI-compatible provider docs (e.g. OpenVINO Model Server, vLLM) and covers:
npm i -g @qvac/cli) and starting the server (qvac serve openai, default port11434).qvac.config.jsonand matching themodelfield to a serve alias.config.yaml/config.jsonexample usingprovider: openai,apiBase: http://127.0.0.1:11434/v1, and a placeholderapiKey.ctx_sizeexplicitly (the default is small), setreasoning_budget: 0for reasoning-tuned models like Qwen3, and use a capable agent-tuned model such asgpt-oss-20bfor tool-calling quality.The page is registered in the More Providers navigation and added to the Local Model Options table in the providers overview.
Checklist
Screen recording or screenshot
Docs-only change.
Tests
Docs-only change. Verified
docs/docs.jsonremains valid JSON after adding the navigation entry.Summary by cubic
Add QVAC to the model providers docs with a new page on running its OpenAI-compatible server and connecting via the built-in
openaiprovider using a localapiBase. Updates navigation and the providers overview, switches docs toqvac.tether.io, and adds a note for reasoning-tuned models (e.g., Qwen3.5).@qvac/cli, start withqvac serve openai(default port 11434).provider: openai,apiBase: http://127.0.0.1:11434/v1, any non-emptyapiKey, and model aliases fromqvac.config.json.ctx_size; setreasoning_budget: 0for reasoning-tuned models like Qwen3.5; use a capable model likegpt-oss-20bfor tools.Written for commit 2adf2ea. Summary will update on new commits.